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IMAGE PROCESSING OF IMAGE DATA 
Background of the Invention 

[0001] 

5 Field of the Invention 

The present invention relates to image processing technology 
employing shooting information at the time of shooting, and image 
processing control information that designates image processing conditions 
to be used when performing image processing on image data. 

10 [0002] 

Description of related Art 

To date, there have been proposed techniques for performing image 
processing of image data created by an image data generating apparatus 
such as a digital still camera (DSC), which involve performing image 

15 processing with reference to shooting information (shooting conditions) at 
the time of shooting, and image processing control information that 
designates processing conditions to be used during image processing. 
Shooting information and image processing control information is typically 
described in the header of the image data, and is associated with a 

20 particular set of image data. 

[0003] According to this image processing technique, where shooting 
information is used, it becomes possible to perform on image data image 
processing that is adapted to the shooting conditions, thus preventing 
image processing that is inappropriate for a particular type of 

25 photographed scene, for example. Where image processing control 

information is used, it becomes possible to perform on image data image 
processing based on certain image processing conditions contemplated at 
the time of shooting, so that output images reflect the photographer's 
intention or the DSC vendor's design. 

30 [0004] With the prior art image processing apparatus, however, since 
the idea was to use either shooting information or image processing control 
information, if an image processing apparatus were designed to be capable 
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of image processing using image processing control information, it could 
not utilize shooting information, even if such information were associated 
with the image data. 

[0005] Also, in the event that a portion of one set of information cannot 
5 be used, if the other set of information includes information corresponding 
to the information that cannot be used, it will not be possible to use the 
aforementioned information. Accordingly, there is a need to perform 
image processing in an appropriate manner, that mutually utilizes, in an 
effective manner, shooting information and image processing control 
10 information. 
[0006] 

Summary of the Invention 
The present invention is intended to address this need, and has as 
an object to provide image processing that reflects shooting conditions and 
15 the photographer's intention, by mutually utilizing shooting information and 
image processing control information. 

[0007] In a first aspect for addressing the aforementioned problem, the 
invention provides a method for image processing of image data. The 
method pertaining to this first aspect comprising acquiring shooting 

20 information that indicates shooting conditions at the time of shooting, said 
information describing a plurality of shooting condition parameters; 
acquiring image processing control information that designates a plurality 
of picture quality adjustment parameters to be used during image 
processing, said information describing a plurality of specifying 

25 parameters; setting said plurality of picture quality adjustment parameters 
on the basis of said plurality of specifying parameters, while for any of said 
plurality of picture quality adjustment parameters that is not set by means 
of said specifying parameters, setting these said picture quality adjustment 
parameters on the basis of said shooting condition parameters; and 

30 executing image processing of said image data using said set picture 
quality adjustment parameters. 

[0008] According to the image processing method which pertains to 
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this first aspect, a plurality of picture quality adjustment parameters are set 
on the basis of a plurality of specifying parameters, or where a quality 
adjustment parameter is not set by means of a specifying parameter, a 
picture quality adjustment parameter set on the basis of shooting condition 
5 parameters is used instead, and image processing of image data is 

performed using picture quality adjustment parameter set thusly, whereby 
image processing can be carried out in such a way as to reflect, in the 
image output characteristics of an output apparatus, the shooting 
conditions and the photographer's intention, by mutually utilizing shooting 

10 information and image processing control information. 

[0009] In the image processing method that pertains to the first aspect 
of the invention, said plurality of specifying parameters may include 
parameters that make up particular combinations of specifying parameters 
appropriate to particular shooting scenes, for designating image 

15 processing depending on the shooting scene; and said shooting condition 
parameters may include scene-specific shooting condition parameters 
describing a particular shooting scene set at the time of shooting. This 
makes it possible to set a plurality of parameters all at once on a shooting 
scene-by-scene basis, facilitating shooting scene-appropriate image 

20 processing on a shooting scene-by-scene basis. 

[0010] In the image processing method that pertains to the first aspect 
of the invention, image processing of said image data may comprise 
analyzing said image data to extract characteristic parameters that indicate 
picture quality characteristics of image data; acquiring a plurality of 

25 standard parameters predetermined for said plurality of picture quality 
adjustment parameters and serving as targets in picture quality 
adjustment; and adjusting picture quality of said image data by eliminating 
or reducing any deviation between each value of said characteristic 
parameters and each value of said acquired standard picture quality 

30 parameters with reflecting said plurality of picture quality adjustment 
parameters. In addition to picture quality adjustment using shooting 
information or image processing control information, this arrangement 
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enables to carry out picture quality adjustment adapted to the picture 
quality of each set of image data, whereby it is possible to perform more 
appropriate image processing on an image data-by-image data basis. 
[0011] The first aspect of the present invention may also be embodied 
5 as an image processing method for executing image processing of image 
data. The image processing apparatus pertaining to the first aspect of the 
invention comprises shooting information acquisition logic for acquiring 
shooting information that indicates shooting conditions at the time of 
shooting, said information describing a plurality of shooting condition 

10 parameters; image processing control information acquisition logic for 

acquiring image processing control information that designates a plurality 
of picture quality adjustment parameters to be used during image 
processing, said information describing a plurality of specifying 
parameters; picture quality adjustment parameter setting logic for setting 

15 said plurality of picture quality adjustment parameters on the basis of said 
plurality of specifying parameters, while for any of said plurality of picture 
quality adjustment parameters that is not set by means of said specifying 
parameters, setting these said picture quality adjustment parameters on 
the basis of said shooting condition parameters; and image processing 

20 logic for executing image processing of said image data using said set 
picture quality adjustment parameters. 

[0012] The image processing apparatus pertaining to the first aspect of 
the invention has similar functions and effects to those of the image 
processing method pertaining to the first aspect of the invention and has 

25 various arrangements as discussed above with regard to the image 
processing method pertaining to the first aspect of the invention. 
[0013] The first aspect of the present invention may also be embodied 
as a computer program product having stored thereon image processing 
program instructions for executing image processing of image data. The 

30 computer program product pertaining to the first aspect of the invention 
comprises a program instruction for acquiring shooting information that 
indicates shooting conditions at the time of shooting, said information 
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describing a plurality of shooting condition parameters; a program 
instruction for acquiring image processing control information that 
designates a plurality of picture quality adjustment parameters to be used 
during image processing, said information describing a plurality of 
5 specifying parameters; a program instruction for setting said plurality of 
picture quality adjustment parameters on the basis of said plurality of 
specifying parameters, while for any of said plurality of picture quality 
adjustment parameters that is not set by means of said specifying 
parameters, setting these said picture quality adjustment parameters on 
10 the basis of said shooting condition parameters; and a program instruction 
for executing image processing of said image data using said set picture 
quality adjustment parameters. 

[0014] The computer program product pertaining to the first aspect of 
the invention has similar functions and effects to those of the image 

15 processing method pertaining to the first aspect of the invention and has 
various arrangements as discussed above with regard to the image 
processing method pertaining to the first aspect of the invention. 
[0015] The invention in a second aspect thereof provides a method for 
image processing of image data that has been associated with at least one 

20 set of information selected from shooting information indicating shooting 
conditions at the time of shooting, and image processing control 
information designating a plurality of picture quality adjustment parameters 
to be used during image processing. The method pertaining to the 
second aspect of the invention comprises acquiring said image data; 

25 searching, from among the image processing conditions associated with 
said image data, for a scene-specific shooting condition parameter 
depending on a particular shooting scene; in the event that a said scene- 
specific shooting condition parameter is not found, searching, from among 
the shooting conditions associated with said image data, for a shooting 

30 scene condition; searching, from among the image processing conditions 
associated with said image data, for an arbitrary image processing 
designating condition that arbitrarily designates an image processing 
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condition; in the event that a said arbitrary image processing designating 
condition is not found, searching, from among the shooting conditions 
associated with said image data, for an arbitrarily set shooting condition; 
and acquiring each said searched for condition, and executing image 
5 processing of said image data using said acquired conditions. 

[0016] According to the image processing method that pertains to the 
second aspect of the invention, image processing conditions associated 
with a set of image data are searched for a scene-specific shooting 
condition parameter depending on the shooting scene; in the event that a 

10 said scene-specific shooting condition parameter is not found, shooting 
conditions associated with the image data are searched for a shooting 
scene condition; the image processing conditions associated with the 
image data are searched for an arbitrary image processing designating 
condition that arbitrarily designates an image processing condition; in the 

15 event that an arbitrary image processing designating condition is not found, 
the shooting conditions associated with said image data are searched for 
an arbitrarily set shooting condition; and the conditions acquired through 
the searches are used to execute image processing of the image data, 
whereby image processing can be carried out in such a way as to reflect, 

20 in the image output characteristics of an output device, the shooting 

conditions and the photographer's intention, by mutually utilizing shooting 
information and image processing control information. 

[0017] In the image processing method pertaining to the second aspect 
of the invention, image processing of image data may comprise analyzing 

25 said image data to extract characteristic parameters that indicate picture 
quality characteristics of image data; acquiring a plurality of standard 
parameters serving as targets in picture quality adjustment; and adjusting 
picture quality of said image data by eliminating or reducing any deviation 
between each value of said characteristic parameters and each value of 

30 said acquired standard picture quality parameters with reflecting said 
plurality acquired. 

In addition to picture quality adjustment using shooting information or 
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image processing control information, this arrangement enables to carry 
out picture quality adjustment adapted to the picture quality of each set of 
image data, whereby it is possible to perform more appropriate image 
processing on an image data-by-image data basis. 
5 [0018] The second aspect of the invention may also be embodied as 
an image processing apparatus for executing image processing of image 
data that has been associated with at least one set of information selected 
from shooting information indicating shooting conditions at the time of 
shooting, and image processing control information designating a plurality 

10 of picture quality adjustment parameters to be used during image 

processing. The image processing apparatus pertaining to the second 
aspect of the invention comprises image data acquisition logic for acquiring 
said image data; first search logic for searching, from among the image 
processing conditions associated with said image data, for a scene-specific 

15 shooting condition parameter depending on a particular shooting scene, 
and in the event that a said scene-specific shooting condition parameter is 
not found, searching, from among the shooting conditions associated with 
said image data, for a shooting scene condition; second search logic for 
searching, from among the image processing conditions associated with 

20 said image data, for an arbitrary image processing designating condition 
that arbitrarily designates an image processing condition, and in the event 
that a said arbitrary image processing designating condition is not found, 
searching, from among the shooting conditions associated with said image 
data, for an arbitrarily set shooting condition; and image processing logic 

25 for executing image processing of said image data using conditions 
acquired by each said search logic. 

[0019] The image processing apparatus pertaining to the second 
aspect of the invention has similar functions and effects to those of the 
image processing method pertaining to the second aspect of the invention 
30 and has various arrangements as discussed above with regard to the 

image processing method pertaining to the second aspect of the invention. 
[0020] The second aspect of the present invention may also be 
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embodied as a computer program product having stored thereon image 
processing program instructions for executing image processing of image 
data that has been associated with at least one set of information selected 
from shooting information indicating shooting conditions at the time of 
5 shooting, and image processing control information designating a plurality 
of picture quality adjustment parameters to be used during image 
processing. The computer program product pertaining to the second 
aspect of the invention comprises a program instruction for acquiring said 
image data; a program instruction for searching, from among the image 

10 processing conditions associated with said image data, for a scene-specific 
shooting condition parameter depending on a particular shooting scene; a 
program instruction that, in the event that a said scene-specific shooting 
condition parameter is not found, searches, from among the shooting 
conditions associated with said image data, for a shooting scene condition; 

15 a program instruction for searching, from among the image processing 
conditions associated with said image data, for an arbitrary image 
processing designating condition that arbitrarily designates an image 
processing condition; a program instruction that, in the event that a said 
arbitrary image processing designating condition is not found, searches, 

20 from among the shooting conditions associated with said image data, for 
an arbitrarily set shooting condition; and a program instruction for acquiring 
each said searched for condition, and executing image processing of said 
image data using said acquired conditions. 

[0021] The computer program product pertaining to the second aspect 
25 of the invention has similar functions and effects to those of the image 
processing method pertaining to the second aspect of the invention and 
has various arrangements as discussed above with regard to the image 
processing method pertaining to the second aspect of the invention. 
[0022] The invention in a third aspect thereof provides a method for 
30 image processing of image data that has been associated with at least one 
set of information selected from shooting information indicating shooting 
conditions at the time of shooting, and image processing control 
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information designating a plurality of picture quality adjustment parameters 
to be used during image processing. The method pertaining to the third 
aspect of the invention comprises acquiring shooting scene information 
from said shooting conditions; defining scene correction information on the 
5 basis of said acquired shooting scene information; searching among said 
image processing conditions for a scene-specific image processing 
condition that designates an image processing condition on a scene- 
specific basis; in the event that said scene-specific image processing 
condition is found among said image processing conditions, replacing said 

10 scene correction information with said scene-specific image processing 
condition; acquiring arbitrary correction information from said shooting 
conditions; defining image arbitrary correction information on the basis of 
the acquired said arbitrary correction information; searching among said 
image processing conditions for an arbitrary image processing condition 

15 designating an arbitrarily selected image processing condition; in the event 
that a said arbitrary image processing condition is found among said image 
processing conditions, and executing image processing of said image data 
on the basis of said scene correction condition and said image arbitrary 
correction information. 

20 [0023] According to the image processing method which pertains to the 
third aspect of the invention, scene correction information and image 
arbitrary correction information are acquired from shooting information and 
image processing control information, and image processing of image data 
is performed on the basis of both types of correction information, whereby 

25 image processing can be carried out in such a way as to reflect, in the 
image output characteristics of an output device, the shooting conditions 
and the photographers intention, by mutually utilizing shooting information 
and image processing control information. 

[0024] In the image processing method which pertains to the third 
30 aspect of the invention, image processing of image data may comprise 

analyzing said image data to extract characteristic parameters that indicate 
picture quality characteristics of image data; acquiring a plurality of 
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standard parameters serving as targets in picture quality adjustment; and 
adjusting picture quality of said image data by eliminating or reducing any 
deviation between each value of said characteristic parameters and each 
value of said acquired standard picture quality parameters with reflecting 
5 said scene correction condition and said image arbitrary correction 
information. In addition to picture quality adjustment using shooting 
information or image processing control information, this arrangement 
enables to carry out picture quality adjustment adapted to the picture 
quality of each set of image data, whereby it is possible to perform more 

10 appropriate image processing on an image data-by-image data basis. 

[0025] The third aspect of the invention may also be embodied as an 
image processing apparatus for executing image processing of image data 
that has been associated with at least one set of information selected from 
shooting information indicating shooting conditions at the time of shooting, 

15 and image processing control information designating a plurality of picture 
quality adjustment parameters to be used during image processing. The 
image processing apparatus pertaining to the third aspect of the invention 
comprises scene information acquisition logic for acquiring shooting scene 
information from said shooting conditions, and defining scene correction 

20 information; first search logic for searching among said image processing 
conditions for a scene-specific image processing condition that designates 
an image processing condition on a scene-specific basis; scene correction 
information update logic that, in the event that a said scene-specific image 
processing condition is found among said image processing conditions, 

25 replaces said scene correction information with said scene-specific image 
processing condition; arbitrary correction information acquisition logic for 
acquiring arbitrary correction information from said shooting conditions, 
and defining image arbitrary correction information; second search logic for 
searching among said image processing conditions for an arbitrary image 

30 processing condition designating an arbitrarily selected image processing 
condition; image arbitrary correction information update logic that, in the 
event that a said arbitrary image processing condition is found among said 
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image processing conditions, replaces said image arbitrary correction 
information with said arbitrary image processing condition; and picture 
quality adjustment logic for executing image processing of said image data 
on the basis of said scene correction condition and said image arbitrary 
5 correction information. 

[0026] The image processing apparatus pertaining to the third aspect 
of the invention has similar functions and effects to those of the image 
processing method pertaining to the third aspect of the invention and has 
various arrangements as discussed above with regard to the image 

10 processing method pertaining to the third aspect of the invention. 

[0027] The third aspect of the present invention may also be embodied 
as a computer program product having stored thereon image processing 
program instructions for executing image processing of image data that 
has been associated with at least one set of information selected from 

15 shooting information indicating shooting conditions at the time of shooting, 
and image processing control information designating a plurality of picture 
quality adjustment parameters to be used during image processing. The 
computer program product pertaining to the third aspect of the invention 
comprises a program instruction for acquiring shooting scene information 

20 from said shooting conditions; a program instruction for defining scene 
correction information on the basis of said acquired shooting scene 
information; a program instruction for searching among said image 
processing conditions for a scene-specific image processing condition that 
designates an image processing condition on a scene-specific basis; a 

25 program instruction that, in the event that said scene-specific image 

processing condition is found among said image processing conditions, 
replaces said scene correction information with said scene-specific image 
processing condition; a program instruction for acquiring arbitrary 
correction information from said shooting conditions; a program instruction 

30 for defining image arbitrary correction information on the basis of the 
acquired said arbitrary correction information; a program instruction for 
searching among said image processing conditions for an arbitrary image 
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processing condition designating an arbitrarily selected image processing 
condition; a program instruction that, in the event that a said arbitrary 
image processing condition is found among said image processing 
conditions, replaces said image arbitrary correction information with said 
5 arbitrary image processing condition; and a program instruction for 

executing image processing of said image data on the basis of said scene 
correction condition and said image arbitrary correction information. 
[0028] The computer program product pertaining to the third aspect of 
the invention has similar functions and effects to those of the image 

10 processing method pertaining to the third aspect of the invention and has 
various arrangements as discussed above with regard to the image 
processing method pertaining to the third aspect of the invention. 
[0029] The invention in a fourth aspect thereof provides a method for 
image processing of image data that has been associated with at least one 

15 set of information selected from shooting information that indicates 

shooting conditions at the time of shooting, and image processing control 
information that designates a plurality of picture quality adjustment 
parameters to be used during image processing. The image processing 
method pertaining to the fourth aspect of the invention comprises selecting 

20 either said shooting information or said image processing control 
information; acquiring as information either said selected shooting 
information or said image processing control information; and executing 
picture quality adjustment processing of said image data using said 
acquired information. 

25 [0030] According to the image processing method which pertains to the 
fourth aspect of the invention, either selected shooting information or 
image processing control information is acquired, and image processing of 
the image data is performed using the acquired information, whereby 
image processing can be carried out in such a way as to reflect the 

30 shooting conditions and the photographer's intention, by mutually utilizing 
shooting information and image processing control information. 
[0031] The image processing method pertaining to the fourth aspect of 
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the invention can also be embodied as a image processing apparatus, or 
computer program product having stored thereon image processing 
program instructions. 
[0032] 

5 Brief Description of the Drawings 

Fig. 1 shows the features of image processing executed in the image 
processing apparatus pertaining to an embodiment. 

Fig. 2 shows a simplified illustration of a image processing system 
that includes the image processing apparatus pertaining to the 
10 embodiment. 

Fig. 3 shows examples of parameters described as shooting 
information SI and image processing control information Gl. 

Fig. 4 is a flowchart showing the process routine of image 
processing executed by thee image processing apparatus of the 
15 embodiment. 

Fig. 5 is a flowchart showing the process routine for the color space 
setting process executed in the flowchart of Fig. 4. 

Fig. 6 is a flowchart showing the process routine for the scene 
correction condition setting process executed in the flowchart of Fig. 4. 
20 Fig. 7 is a flowchart showing the process routine for the arbitrary 

correction condition setting process executed in the flowchart of Fig. 4. 

Fig. 8 is a flowchart showing the process routine for the manual 
correction condition setting process executed in the flowchart of Fig. 4. 
Fig. 9 is a flowchart showing the process routine for the automatic 
25 correction level AP setting process executed in the flowchart of Fig. 4. 
[0033] 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
A fuller understanding of the image processing apparatus pertaining 
to the invention is provided through the following description of an 
30 embodiment, making reference to the accompanying drawings. 
[0034] The following description of the features of the image 
processing apparatus pertaining to the embodiment makes reference to 
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Fig. 1. Fig. 1 is an illustration showing the features of image processing 
executed in the image processing apparatus pertaining to the embodiment. 
[0035] In the image processing apparatus pertaining to the 
embodiment, image processing is carried out through mutual effective use 
5 of shooting information SI, which is associated with image data generated 
by a digital still camera (DSC) and describes shooting conditions at the 
time of shooting, and image processing control information Gl that 
designates image processing conditions for the image data. The 
parameters included in shooting information SI and image processing 

10 control information Gl will be described later; however, let it be noted here 
that shooting information SI describes the shooting conditions of shutter 
speed, exposure, and selected shooting scene at the time of shooting. 
Image processing control information Gl, on the other hand, describes 
information that designates image processing conditions when performing 

15 image processing of image data, such as the image processing conditions 
of image processing conditions for a particular shooting scene, and 
working color space, for example. 

[0036] When image data is input to image processing apparatus 10, 
the image data is analyzed to derive a picture quality characteristic value 

20 (statistical value), for example a histogram, indicating a particular picture 
quality. Using the shooting information SI and image processing control 
information Gl corresponding to the image data input to it, image 
processing apparatus 10 defines a scene correction condition and an 
arbitrary correction condition. When defining the scene correction 

25 condition and arbitrary correction condition, the image processing 

apparatus first searches the shooting information SI for a description of a 
parameter relating to the scene correction condition, and in the event that it 
finds a parameter relating to the scene correction condition, adopts on a 
temporary basis the value of parameter resulting from the search as the 

30 scene correction condition. The image processing apparatus 10 then 

searches the image processing control information Gl for a description of a 
parameter designating the scene correction condition, and in the event that 
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it finds a parameter relating to the scene correction condition, the 
previously adopted scene correction condition is overwritten (updated) with 
the value of the parameter resulting from the search, which is defined as 
the final scene correction condition. 
5 [0037] The image processing apparatus 10 then first searches the 
shooting information SI for a description of a parameter relating to the 
arbitrary correction condition, and in the event that it finds a parameter 
relating to the scene correction condition, adopts on a temporary basis the 
value of parameter resulting from the search as the arbitrary correction 

10 condition. The image processing apparatus 10 then searches the image 
processing control information Gl for a description of a parameter 
designating the arbitrary correction condition, and in the event that it finds 
a parameter relating to the arbitrary correction condition, the previously 
adopted arbitrary correction condition is overwritten (updated) with the 

15 value of the parameter resulting from the search, which is selected as the 
final arbitrary correction condition. That is, with the image processing 
apparatus 10 pertaining to the embodiment, while preference is given to 
using parameter values (information) described in the image processing 
control information Gl, for values of parameters that cannot be adopted 

20 from image processing control information Gl, from shooting information SI 
are adopted instead, with the aim of effective mutual utilization of both 
image processing control information Gl and shooting information SI. 
[0038] On the basis of the acquired picture quality characteristic value, 
the scene correction condition, and the arbitrary correction condition, 

25 image processing apparatus 10 defines an automatic correction level 

(correction value) AP. The image processing apparatus also searches the 
image processing control information Gl for a manual correction condition 
included therein, and defines a manual correction level (correction value) 
MP. An automatic correction level AP is a correction level defined using 

30 the three parameters of picture quality characteristic value, scene 
correction condition, and arbitrary correction condition, plus standard 
values which are target values for picture quality adjustment, that have 
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been predetermined for each parameter; the picture quality adjustment 
process using the defined correction level is typically termed an automatic 
picture quality adjustment or automatic correction process. That is, in an 
automatic picture quality adjustment process, a correction level is defined 
5 so as to reduce or eliminate any deviation (difference) between parameters 
relating to a certain picture quality, for example, an acquired picture quality 
characteristic value for contrast and the predetermined standard value for 
contrast; in the embodiment, the extent of this elimination/reduction is 
determined more appropriately on the basis of the three parameters of 

10 picture quality characteristic value, scene correction condition, and 

arbitrary correction condition, to define an automatic correction level AP. 
A manual correction level MP, on the other hand, differs in that the value of 
a parameter relating to a picture quality described in the image processing 
control information Gl is used as-is as the manual correction level MP. 

15 [0039] Using the defined automatic correction levels AP and manual 
correction levels MP, image processing apparatus 10 performs picture 
quality adjustment process to correct the values of the parameters of the 
image data, and outputs the processed image data to drivers for various 
output devices. Foregoing logics are implemented by CPU 100 alone, or 

20 together with ROM 101, HDD 102, and RAM 103. Following is a more 

detailed description of image processing executed in the image processing 
apparatus pertaining to the embodiment. 

[0040] The following description of a image processing system that 
includes the image processing apparatus pertaining to the embodiment 

25 makes reference to Fig. 2. 

Fig. 2 is a simplified illustration of a image processing system that includes 
the image processing apparatus pertaining to the embodiment. 
[0041] In the embodiment, the image processing apparatus is 
embodied as a personal computer PC. Personal computer PC comprises 

30 a central processing unit (CPU) 100 for executing various image 

processing operations, including a noise reduction process; read-only 
memory (ROM) 101 and a hard disk (HDD) 102 having stored therein a 
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reference table, a program for executing image processing using shooting 
information SI and image processing control information Gl, and the like; 
and random access memory (RAM) 103 for temporary storage of various 
kinds of input data, such as image data. CPU 100 alone, or together with 
5 ROM 101, HDD 102, and RAM 103, constitutes a given logic. 

[0042] Personal computer PC additionally comprises an input interface 
for exchanging data and control signals with peripheral input devices; and 
an output interface for exchanging data and control signals with peripheral 
output devices. "Interface" herein refers both to a connector terminal (i.e., 
10 the hardware aspect) for connecting a peripheral device, and to the 

process of converting a signal (i.e., the software aspect) from a peripheral 
device. 

[0043] In the embodiment, personal computer PC has a display device 
110 and a printer 20 connected to it as peripheral devices. Image data 

15 reflecting the results of image processing is sent in real time to display 
device 110, which displays the output image. Image data for printing, 
which has been subjected to image processing and converted to data for 
printing, is sent to printer 20, which prints the output image. 
[0044] As a peripheral input device, a photographic device, namely, a 

20 digital still camera (DSC) 30 is connected. DSC 30 is a photographic 
device that uses photoelectric converter elements, such as a CCD, to 
generate image data; it converts light information (energy) into electrical 
information (energy) by focusing an image of a subject on the CCD through 
an optical lens. When generating image data, DSC 30 writes into the 

25 header of the image data shooting information SI that describes shooting 
conditions set at the time of shooting, and image processing control 
information Gl which is pre-stored in memory (e.g. in ROM) in the DSC 30; 
it then stores the image data on a memory card MC or the like. Image 
data generated by DSC 30 can also be input to personal computer PC via 

30 the memory card MC. 

[0045] Examples of parameters described by way of the shooting 
information SI and image processing control information Gl are as shown 
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in Fig. 3. Fig. 3 is an illustration showing examples of parameters 
described as shooting information SI and image processing control 
information Gl. Parameters described by way of shooting information SI 
may include, for example, the parameters of contrast, saturation, 
5 sharpness, and shooting scene, which indicates one of four shooting 
scenes, namely, Standard, Night Scene, Landscape and Portrait. 
Shooting information SI consists of a description of settings for these 
parameters at the time of shooting. Parameters described by way of 
image processing control information Gl, on the other hand, may include, 

10 for example, the parameters of working color space (NTSC, wRGB); a 

contrast-specifying parameter; a saturation-specifying parameter; a scene- 
specific image processing parameter specifying one of seven shooting 
modes, namely, Standard, Night Scene, Landscape, Portrait, Sports, 
Sunset, Fall Foliage; and a Manual [mode?] -specifying parameter. Image 

15 processing control information Gl is information that has been derived 

experimentally in advance, as giving the desired output result when image 
data generated by any image data generating device, such as a DSC, is 
output as an image by a predetermined output device; it describes values 
for specifying parameters, calculated in advance for DSC/output device 

20 combinations. 

[0046] While the embodiment describes a digital still camera 30 as the 
peripheral input device serving as a photographic device, a scanner, digital 
video camera, or the like could be used instead. Other peripheral input 
devices include a keyboard, mouse, or the like. 

25 [0047] The following description of image processing executed by thee 
image processing apparatus of the embodiment makes reference to Figs. 4 
-9. Fig. 4 is a flowchart showing the process routine of image processing 
executed by thee image processing apparatus of the embodiment. Fig. 5 
is a flowchart showing the process routine for the color space setting 

30 process executed in the flowchart of Fig. 4. Fig. 6 is a flowchart showing 
the process routine for the scene correction condition setting process 
executed in the flowchart of Fig. 4. Fig. 7 is a flowchart showing the 
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process routine for the arbitrary correction condition setting process 
executed in the flowchart of Fig. 4. Fig. 8 is a flowchart showing the 
process routine for the manual correction condition setting process 
executed in the flowchart of Fig. 4. Fig. 9 is a flowchart showing the 
5 process routine for the automatic correction level AP setting process 
executed in the flowchart of Fig. 4. 

[0048] Image processing performed in the embodiment may initiate, for 
example, when a memory card MC is installed in personal computer PC, or 
when DSC 30 is connected to personal computer PC via a communications 

10 cable; or may be executed in response to a image processing instruction 
input by the user from the keyboard or other input device. 
[0049] When image processing initiates, personal computer PC (CPU 
100) acquires image data and temporarily places it in RAM 103 (Step 
S1 00). CPU 1 00 ascertains from the header of the image data whether 

15 the exceptional processing flag is set to "1" (Step S110), and in the event it 
determines that the exceptional processing flag equals "1" (Step S110: 
Yes), proceeds to Step S180, without executing a correction process on 
the image data. 

[0050] If CPU 100 determines that the exceptional processing flag is 
20 not set to "1" (exceptional processing flag = "0") (Step S1 10: No), it 
executes a color space setting process (Step S120). 
[0051] The following specific description of the color space setting 
process refers to Fig. 5. CPU 100 searches the image data header for 
color space information (Step S1200). As noted, since shooting 
25 information SI does not describe color space information, the search is 

directed to a tag in the image processing control information Gl. CPU 100 
searches the image processing control information Gl, and in the event it 
determines that color space information is described (Step S1210: Yes), it 
defines the color space described in the color space information of the 
30 image processing control information Gl as the working color space, 

executes a color conversion process (Step S1220), and returns to the main 
routine. The color space described in the color space information may 
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include, for example, the wRGB color space, which has a wider gamut than 
the NTSC color space or the sRGB [color space]. However, since in most 
instances image data from DSC 30 is YCbCr data, each matrix value of the 
matrix used for YCbCr-wRGB color conversion operations is described by 
5 way of color space information. Accordingly, a process of YCbCr-wRGB 
color conversion, for example, is executed in the color conversion process. 
[0052] In the event that CPU searches the image processing control 
information Gl but determines that no color space information is described, 
or in the event that it cannot search for color space information (Step 

10 S1210: No), the working color space is set to the sRGB color space 

typically used by PC computers, executes a YCbCr-sRGB color conversion 
process (Step S1230), and returns to the main routine. 
[0053] Referring back to Fig. 4, CPU 100 executes a scene correction 
condition setting process (Step S130). The following specific description 

15 of the scene correction condition setting process refers to Fig. 6. In the 
scene correction condition setting process, there is defined a scene 
correction condition constituting one parameter used for defining the 
automatic correction level AP. CPU 100 initiates a search for scene 
information in the header of the image data (Step S1300). CPU 100 

20 determines whether scene information (shooting scene) is described in the 
shooting information SI (Step S1310), and in the event it determines that a 
shooting scene is described (Step S1310: Yes), defines the described 
shooting scene as the scene correction condition for defining automatic 
correction level AP (Step S1320). 

25 [0054] In the event of CPU 100 determining that a shooting scene is 
not described (Step S1310: No), it determines that shooting information SI 
does not describe scene information, and proceeds to Step S1330. 
[0055] CPU 100 then determines whether scene information is 
described in the image processing control information Gl (S1330), and in 

30 the event it determines that a scene-specific image processing parameter 
is described (Step S1330: Yes), it overwrites [any previous setting] and 
defines the described scene-specific image processing parameter as the 
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scene correction condition that defines automatic correction level AP (Step 
S1340), then returns to the main routine. That is, where shooting 
information SI contains a description of scene information, the scene 
correction condition is updated with the scene-specific image processing 
5 parameter in image processing control information Gl; or where shooting 
information SI does not contain a description of scene information, the 
scene-specific image processing parameter in image processing control 
information Gl is made the initial setting for the scene correction condition. 
For example, where shooting information SI describes a "Standard" 
10 shooting scene, but the scene-specific image processing parameter in 

image processing control information Gl describes "Sunset", "Sunset" will 
be employed as the scene correction condition. 

[0056] In the event of CPU 100 determining that a scene-specific 
image processing parameter is not described (Step S1330: No), it 

15 determines that the image processing control information Gl does not 

describe a scene-specific image processing parameter, and returns to the 
main routine. Specifically, where shooting information SI contains a 
description of scene information, a scene correction condition based on the 
shooting information SI is employed; or where shooting information SI does 

20 not contain a description of scene information, no scene correction 
condition is defined. 

[0057] Referring back to Fig. 4, CPU 100 executes an arbitrary 
correction condition setting process (Step S140). The following specific 
description of the arbitrary correction condition setting process refers to 

25 Fig. 7. In the arbitrary correction condition setting process, there is 

defined an arbitrary correction condition constituting one parameter used 
for defining the automatic correction level AP. [These correction 
conditions] differ in that, whereas the scene correction condition is 
intended to define, on a shooting scene unit basis, suitable correction 

30 conditions for a plurality of parameters, the arbitrary correction condition is 
intended to define, on an individual basis, a suitable correction condition 
for an individual parameter. 

21 



PF04J571US 

[0058] CPU 100 initiates a search for arbitrary correction information in 
the header of the image data (Step S1400). CPU 100 determines whether 
arbitrary correction information (contrast, etc.) is described in the shooting 
information SI (Step S1410), and in the event it determines that arbitrary 
5 correction information is described (Step S1410: Yes), defines the 
described arbitrary correction information as the arbitrary correction 
condition for defining automatic picture quality adjustment parameter AP 
(Step S1420). Specifically, a parameter from among, for example, 
contrast, saturation, and sharpness, described as arbitrary correction 
10 information in the shooting information SI, is defined as the arbitrary 
correction condition. 

[0059] In the event of CPU 100 determining that arbitrary correction 
information is not described (Step S1410: No), it determines that shooting 
information SI does not describe arbitrary correction information, and 

15 proceeds to Step S1430. 

[0060] CPU 100 then determines whether arbitrary correction 
information (a contrast specifying parameter, etc.) is described in the 
image processing control information Gl (S1430), and in the event it 
determines that arbitrary correction information is described (Step S1430: 

20 Yes), it overwrites [any previous setting] and defines the described 

arbitrary correction information as the arbitrary correction condition for 
defining automatic picture quality adjustment parameter AP (Step S1440), 
then returns to the main routine. That is, from among, for example, a 
contrast specifying parameter, a saturation specifying parameter, and a 

25 sharpness specifying parameter, a specifying parameter described in the 
image processing control information Gl is defined as the arbitrary 
correction condition. Where shooting information SI contains a 
description of arbitrary correction information, the arbitrary correction 
condition is updated with arbitrary correction information from the image 

30 processing control information Gl; or where shooting information SI does 
not contain a description of arbitrary correction information, the arbitrary 
correction information from the image processing control information Gl is 
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made the initial setting for the arbitrary correction condition. For example, 
where shooting information SI describes "Contrast: Weak, Saturation: 
Standard", but the image processing control information Gl describes 
"Contrast specifying parameter: Standard, Saturation: -", for the Contrast 
5 parameter, the "Standard" setting given in the image processing control 
information Gl will be used; whereas for the Saturation parameter, the 
"Standard" setting given in the shooting information SI will be used, since 
the image processing control information Gl does not contain a description. 
[0061] In the event of CPU 100 determining that arbitrary correction 

10 information is not described (Step S1430: No), it determines that the image 
processing control information Gl does not describe arbitrary correction 
information, and returns to the main routine. Specifically, where shooting 
information SI contains a description of arbitrary correction information, an 
arbitrary correction condition based on the shooting information SI is 

15 employed; or where shooting information SI does not contain a description 
of arbitrary correction information, no arbitrary correction condition is 
defined. 

[0062] Referring back to Fig. 4, CPU 100 executes a manual correction 
setting process (Step S150). The following specific description of the 

20 manual correction setting process refers to Fig. 8. CPU 100 initiates a 
search for manual correction information in the header of the image data 
(Step S1500). Since, as noted, the shooting information SI does not 
describe manual correction information, the search is directed to a tag in 
the image processing control information Gl. CPU 100 searches the 

25 image processing control information Gl, and in the event it determines 

that manual correction information is described (Step S1510: Yes), defines 
the manual correction level MP as the value of each parameter described 
in the manual correction information of image processing control 
information Gl (Step S1520), then returns to the main routine. 

30 Parameters described in manual correction information may include, for 
example, the parameters of contrast, saturation, and brightness; values of 
these parameters are not employed in picture quality adjustment 
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processing using standard values (automatic picture quality adjustment 
processing), but rather employed directly as picture quality correction 
levels for image data. 

[0063] In the event that CPU 100 searches the image processing 
5 control information Gl and determines that no manual correction 

information is described, or in the event that it cannot search the image 
processing control information Gl (Step S1510: No), it returns to the main 
routine without defining manual correction information. 
[0064] Referring back to Fig. 4, CPU 100 executes an automatic 

10 correction level AP setting process (Step S160). The following specific 
description of the automatic correction level AP setting process refers to 
Fig. 9. CPU 100 acquires the scene correction condition defined 
previously (Step S1600), and on the basis of the description of the scene 
correction condition, defines a scene correction level, with respect to a 

15 standard value, for each parameter relating to picture quality (S1610). 
For image processing control information Gl, the scene correction level 
relative to a standard value may describe, for example, a correction trend 
(correction level with respect to a standard value) for each parameter on a 
scene-by-scene basis by way of a scene-specific image processing 

20 parameter; or describe a value indicating a scene by way of a scene- 
specific image processing parameter. In the case of shooting information 
SI, it will correspond to the latter, since only information indicating shooting 
scene is described. 

[0065] CPU 100 acquires an arbitrary correction condition (Step 
25 S1620), and on the basis of the arbitrary correction condition defines an 
arbitrary correction level, with respect to a standard value, for each 
parameter relating to picture quality (S1630). The arbitrary correction 
level with respect to a standard value may describe, for example, a 
correction trend (correction level with respect to a standard value) for an 
30 arbitrary parameter by way of image processing control information Gl or 
shooting information SI; or where a value indicating arbitrary correction 
level is described, the correction level for each parameter may be read out 
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from a reference table pre-stored in ROM 101 or HDD 102. 
[0066] CPU 100 analyzes the image data and acquires picture quality 
characteristic information (picture quality characteristic value) (Step 
S1640). Picture quality characteristic values include, for example, 
5 statistical values (histograms) for the R, G, and B components, and 
luminance. CPU 100 calculates deviation (difference) between picture 
quality characteristic value and standard value for each parameter, and 
applies a scene correction level and arbitrary correction level to deviation 
thusly calculated to define an automatic correction level AP (Step S1650), 

10 then returns to the main routine. For example, in the event that in image 
processing control information Gl, "Landscape" is described as a scene- 
specific image processing parameter, but not described in the contrast- 
specifying parameter, and in the shooting information SI, "Standard" is 
described as the shooting scene, and contrast is described as "Weak", as 

15 contrast is somewhat high in "Landscape" [mode], contrast is adjusted from 
the higher end towards the lower end. 

[0067] Referring back to Fig. 4, CPU 100 executes a picture quality 
adjustment process on the image data, using the automatic correction level 
AP and manual correction level MP defined previously (Step S170). In 

20 this picture quality adjustment process, parameter values of the image data 
are modified (corrected) by means of the automatic correction level AP and 
manual correction level MP. CPU 100 sends the processed image data to 
the printer driver (Step S180), and terminates the processing routine. The 
printer driver executes processes such as RGB-CMYK color conversion 

25 using a lookup table or the like, halftoning, and so on, and outputs the 
image data in the form of raster data to printer 20. 
[0068] According to the image processing apparatus of the 
embodiment described hereinabove, image processing (picture quality 
adjustment) of image data can be carried out through effective use of both 

30 shooting information SI and image processing control information Gl 
associated with the image data. Since preference is normally given to 
image processing control information Gl, which has been defined to reflect 
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the result of image output by an image output device of image data 
generated by an image data generating device, and which specifies image 
processing conditions to be used during image processing, it is possible to 
produce an output result that reflects shooting conditions, the 
5 photographer's intent, and DSC/printer matchup. 

[0069] Even where image processing control information Gl lacks 
useable parameters, since it is possible to use shooting information SI 
which is normally appended to image data created by a DSC 30, image 
processing appropriate to shooting conditions may be carried out under a 
10 wider range of conditions. 
[0070] 

Other embodiments 

In the embodiment described above, image processing was carried 
out using a personal computer PC as the image processing apparatus, but 

15 instead a standalone printer equipped with a image processing function 

could be used as the image processing apparatus, in which case the image 
processing described above would be performed by the printer. 
Embodiment in the form of a printer driver or image processing application 
(program) without any accompanying hardware arrangement, such as a 

20 image processing apparatus, is also possible. 

[0071] While the embodiment described an example of shooting 
information SI and image processing control information Gl being 
described in the image data header, the SI and Gl information could 
instead be provided as another data file associated with image data on a 

25 one-to-one basis. 

[0072] While not discussed in the embodiment, when performing 
YCbCr-sRGB/wRGB color conversion, or when performing wRGB-sRGB 
color conversion, gamma correction and inverse gamma correction may be 
performed as well. 

30 [0073] In the embodiment, image processing control information Gl 
was always given preference in handling, but it would be possible instead 
to enable the user to select whether image processing is performed using 
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image processing control information Gl or shooting information SI. This 
enables image processing to be carried out according to user preference. 
[0074] While a image processing apparatus, image processing method, 
and computer program product containing image processing program 
5 instructions, pertaining to the invention have been shown and described 
through an embodiment, the embodiments of the invention described 
hereinabove are intended merely as an aid in understanding the invention, 
and should not be construed as limiting thereof. Various modifications 
and improvements to the invention are possible within the spirit and scope 
10 of the invention, and the invention will naturally include such equivalents. 
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